Medical Image Analysis: Progress over Two Decades and the Challenges Ahead

The analysis of medical images has been woven into the fabric of the Pattern Analysis and Machine Intelligence (PAMI) community since t h e earliest days of these Transactions. Initially, the efforts in this area were seen as applying pattern analysis and computer vision techniquss lo another interesting dataset. However. over the last two to three decades, the unique nature of the problems presented within this area of study have led to the development of a new dlscipline in its own right. Examples of these include: the types of image information that are acquired, the fully three-dimensional image data, the nonrigid nature of object motion and deformation, and the statistical variation of both the underlying normal and abnormal ground truth. In this paper, we look at progress in the fiold over the last 20 years and suggest some of the challenges that remain for the years to come. Index Term-Medical imaging, medical image analysis, computer vision, image segmentation, image registration, nonrigid motion, deformable contours, image-guided surgery.